TPSurgery: An Innovative Surgery Assistant System

Revolutionizing Surgery with Gesture Control and Tangible User Interface

TPSurgery is an interactive surgery assistant system that combines gesture control and tangible user interface to revolutionize the way surgeons interact with information and adjust surgery light. Designed by J. Du & T.J.A. v. Rooij & T. Wu, this groundbreaking system aims to enhance surgical procedures by providing a more hygienic and convenient control method.

During surgery, surgeons require access to a vast amount of information, which needs to be displayed in a proper and accessible way. Traditional methods, such as tangible screens or buttons, are not suitable for the surgery room as they require sterilization and the surgeon cannot remove their gloves for control. TPSurgery addresses these challenges by introducing gesture control, allowing surgeons to interact with the system without physical contact.

One of the key features of TPSurgery is its ability to adjust surgery light in three dimensions using gestures. By simply moving their hand, surgeons can precisely control the position and intensity of the light, ensuring optimal visibility during the procedure. Additionally, the system provides a seamless way to scan through patient information using intuitive gestures, making it easier for surgeons to access critical data without interrupting the surgery.

What sets TPSurgery apart is the integration of both graphical user interface (GUI) and tangible user interface (TUI). The GUI provides visual feedback and indications, while the TUI enhances the user experience by providing physical feedback through LED belts and speakers. This combination of interfaces creates a more intuitive and immersive interaction, improving usability and reducing the learning curve for surgeons.

The TPSurgery prototype utilizes a combination of leap motion, Arduino, and the Processing language to achieve its functions. LED belts and speakers controlled by Arduino UNO provide the necessary feedback and indications. The design team envisions future iterations of the system to be more compact, with dimensions of 130mm*80mm*30mm, making it more suitable for use in surgery rooms.

During the development of TPSurgery, the design team conducted extensive user testing and analysis to ensure optimal interaction usability. The system provides adequate indications and feedbacks to guide users and prevent errors. For example, if the user's hand is out of the detection range, the corresponding LED belt turns red, alerting the surgeon to adjust their position. The graphical user interface also provides clear feedback for every operation, further enhancing the user experience.

The TPSurgery project was initiated in November 2015 and completed in February 2016 in Eindhoven. It was exhibited at Innovation for Health in Rotterdam in February 2016, showcasing its potential to revolutionize surgical procedures. The design team's research was guided by the MPCA (mirrored perception cognition action) model and 5A questions (address, attending, action, alignment, accident) analysis, ensuring a comprehensive understanding of the user's needs and interactions.

TPSurgery was awarded the Silver A' Design Award in the Medical Devices and Medical Equipment Design category in 2016. This prestigious award recognizes the system's outstanding expertise, innovation, and remarkable level of excellence. TPSurgery introduces positive feelings, amazement, and wonder, setting a new standard for surgery assistant systems.


Project Details and Credits

Project Designers: Jiachun
Image Credits: Image #1 : Qi Qi
Project Team Members: Jiachun Du Tom van Rooij Tong Wu
Project Name: TPSurgery
Project Client: Jiachun


TPSurgery IMG #2
TPSurgery IMG #3
TPSurgery IMG #4
TPSurgery IMG #5
TPSurgery IMG #5

Read More on Design Radiant